Measuring Task-Related Brain Activity With Event-Related Potentials in Dynamic Task Scenario With Immersive Virtual Reality Environment.

Measurement of event-related potentials (ERPs) in simulated and real environments is advantageous for understanding cognition and behavior during practice of goal-directed activities. Recently, instead of using task-irrelevant "probe stimuli" to elicit ERPs, extraction of ERPs directly from events that occur in simulated and real environments has drawn increased attention. Among the previous ERP studies using immersive virtual reality, only a few cases elicited ERPs from task-related events in dynamic task settings. Furthermore, as far as we surveyed, there were no studies that examined the source of ERPs or correlation between ERPs and behavioral performance in 360-degree immersive virtual reality using head-mounted display. In this study, EEG signals were recorded from 16 participants while they were playing the first-person shooter game with immersive virtual reality environment. Error related negativity (ERN) and correct-(response)-related negativity (CRN) elicited by shooting-related events were successfully extracted. We found the ERN amplitudes to be correlated with the individual shooting performance. Interestingly, the main source of the ERN was the rostral anterior cingulate cortex (ACC), which is different from previous studies where the signal source was often estimated to be the more caudal part of ACC. The obtained results are expected to contribute to the evaluation of cognitive functions and behavioral performance by ERPs in a simulated environment.

Infants' ability to respond to depth from the retinal size of human faces: comparing monocular and binocular preferential-looking.

To examine sensitivity to pictorial depth cues in young infants (4 and 5 months-of-age), we compared monocular and binocular preferential looking to a display on which two faces were equidistantly presented and one was larger than the other, depicting depth from the size of human faces. Because human faces vary little in size, the correlation between retinal size and distance can provide depth information. As a result, adults perceive a larger face as closer than a smaller one. Although binocular information for depth provided information that the faces in our display were equidistant, under monocular viewing, no such information was provided. Rather, the size of the faces indicated that one was closer than the other. Infants are known to look longer at apparently closer objects. Therefore, we hypothesized that infants would look longer at a larger face in the monocular than in the binocular condition if they perceived depth from the size of human faces. Because the displays were identical in the two conditions, any difference in looking-behavior between monocular and binocular viewing indicated sensitivity to depth information. Results showed that 5-month-old infants preferred the larger, apparently closer, face in the monocular condition compared to the binocular condition when static displays were presented. In addition, when presented with a dynamic display, 4-month-old infants showed a stronger 'closer' preference in the monocular condition compared to the binocular condition. This was not the case when the faces were inverted. These results suggest that even 4-month-old infants respond to depth information from a depth cue that may require learning, the size of faces.

Steady-state visual-evoked response to upright and inverted geometrical faces: a magnetoencephalography study.

The face is one of the most important visual stimuli in human life, and inverted faces are known to elicit different brain responses than upright faces. This study analyzed steady-state visual-evoked magnetic fields (SSVEFs) in eleven healthy participants when they viewed upright and inverted geometrical faces presented at 6Hz. Steady-state visual-evoked responses are useful measurements and have the advantages of robustness and a high signal-to-noise ratio. Spectrum analysis revealed clear responses to both upright and inverted faces at the fundamental stimulation frequency (6 Hz) and harmonics, i.e. SSVEFs. No significant difference was observed in the SSVEF amplitude at 6 Hz between upright and inverted faces, which was different from the transient visual-evoked response, N170. On the other hand, SSVEFs were delayed with the inverted face in the right temporal area, which was similar to N170 and the results of previous steady-state visual-evoked potentials studies. These results suggest that different mechanisms underlie the larger amplitude and delayed latency observed with face inversion, though further studies are needed to fully elucidate these mechanisms. Our study revealed that SSVEFs, which have practical advantages for measurements, could provide novel findings in human face processing.

Measuring young infants' sensitivity to height-in-the-picture-plane by contrasting monocular and binocular preferential-looking.

To examine young infants' sensitivity to a pictorial depth cue, we compared monocular and binocular preferential looking to objects of which depth was specified by height-in-the-picture-plane. For adults, this cue generates the perception that a lower object is closer than a higher object. This study showed that 4- and 5-month-old infants fixated the lower, apparently closer, figure more often under the monocular than binocular presentation providing evidence of their sensitivity to the pictorial depth cue. Because the displays were identical in the two conditions except for binocular information for depth, the difference in looking-behavior indicated sensitivity to depth information, excluding a possibility that they responded to 2D characteristics. This study also confirmed the usefulness of the method, preferential looking with a monocular and binocular comparison, to examine sensitivity to a pictorial depth cue in young infants, who are too immature to reach reliably for the closer of two objects.

Prepulse inhibition of change-related P50m no correlation with P50m gating.

Both prepulse inhibition (PPI) of the startle response and P50 sensory gating are important tools to investigate the inhibitory mechanisms of sensory processing. However, previous studies found no or a weak association between these two measures, which may have been due to the different indexes used. We examined the relationship between P50 sensory gating and P50 PPI. P50m sensory gating and PPI of Change-related P50m were assessed in 14 subjects using magnetoencephalography. Concerning P50m sensory gating, the amplitudes of the response to the second click relative to that to the first one were reduced by 43 and 47% for the left and right hemisphere, respectively. Change-related P50m was evoked by an abrupt sound pressure increase by 10 dB in a continuous click train of 70 dB. When this test stimulus was preceded by a click (prepulse) with a weaker sound pressure increase (5 dB) at a prepulse-test interval of 30, 60, or 90 ms, Change-P50m was suppressed by 33 ~ 65% while the prepulse itself elicited no or very weak P50m responses. Although the amplitude of the P50m response to the first click and the amplitude of the Change-P50m test alone response were positively correlated (r = 0.6), the degree of the inhibition of the two measures was not (r = -0.06 ~ 0.14). The neural origin was estimated to be located in the supratemporal plane around the superior temporal gyrus or Heschl's gyrus and did not differ between P50m and Change-P50m. The present results suggest that P50m and Change-P50m are generated by a similar group of neurons in the auditory cortex, while the mechanisms of P50m sensory gating and Change-P50m PPI are different.

Effects of acute nicotine on prepulse inhibition of auditory change-related cortical responses.

Prepulse inhibition (PPI) of startle is a measure of inhibitory function in which a weak leading stimulus suppresses the startle response to an intense stimulus. Usually, startle blink reflexes to an intense sound are used for measuring PPI. A recent magnetoencephalographic study showed that a similar phenomenon is observed for auditory change-related cortical response (Change-N1m) to an abrupt change in sound features. It has been well established that nicotine enhances PPI of startle. Therefore, in the present magnetoencephalographic study, the effects of acute nicotine on PPI of the Change-N1m were studied in 12 healthy subjects (two females and 10 males) under a repeated measures and placebo-controlled design. Nicotine (4 mg) was given as nicotine gum. The test Change-N1m response was elicited with an abrupt increase in sound pressure by 6 dB in a continuous background sound of 65 dB. PPI was produced by an insertion of a prepulse with a 3-dB-louder or 6-dB-weaker sound pressure than the background 75 ms before the test stimulus. Results show that nicotine tended to enhance the test Change-N1m response and significantly enhanced PPI for both prepulses. Therefore, nicotine's enhancing effect on PPI of the Change-N1m was similar to that on PPI of the startle. The present results suggest that the two measures share at least some mechanisms.

Effects of spatial frequency on visual evoked magnetic fields.

Psychophysical and visual evoked potential (VEP) studies have shown that spatial frequency of a visual stimulus affects contrast sensitivity and VEPs in humans. However, it is not clear whether and how the effect of spatial frequency varies among cortical areas. Considering that all visual inputs to the retina could be expressed as a sum of sinusoidal gratings of different spatial frequencies, the effect of spatial frequency must be clarified to separate the brain activity specific to each visual stimulus. In order to examine the effect of spatial frequency on different cortical areas, the present study compared cortical responses to sinusoidal gratings of seven different spatial frequencies using magnetoencephalography (MEG). MEG waveforms of twelve healthy adults in response to sinusoidal gratings of 0.3-18.1 cycles per degree were subjected to a multi-dipole analysis. As a result, the effect of spatial frequency was significant on the first peak latency and amplitude of the source activity around V1 and V2 but not on the source activity around V3 and V6, indicating that the effect of spatial frequency varies across different visual areas in the human brain. Our results also suggest that the responses in V1 and V2 that have a peak around 90 ms and that of V6 peaking around 120 ms should be separated to investigate the stimulus-specific cortical response, particularly when examining effects of spatial frequency on the response latency.

Prepulse inhibition of auditory change-related cortical responses.

BACKGROUND: Prepulse inhibition (PPI) of the startle response is an important tool to investigate the biology of schizophrenia. PPI is usually observed by use of a startle reflex such as blinking following an intense sound. A similar phenomenon has not been reported for cortical responses. RESULTS: In 12 healthy subjects, change-related cortical activity in response to an abrupt increase of sound pressure by 5 dB above the background of 65 dB SPL (test stimulus) was measured using magnetoencephalography. The test stimulus evoked a clear cortical response peaking at around 130 ms (Change-N1m). In Experiment 1, effects of the intensity of a prepulse (0.5 ~ 5 dB) on the test response were examined using a paired stimulation paradigm. In Experiment 2, effects of the interval between the prepulse and test stimulus were examined using interstimulus intervals (ISIs) of 50 ~ 350 ms. When the test stimulus was preceded by the prepulse, the Change-N1m was more strongly inhibited by a stronger prepulse (Experiment 1) and a shorter ISI prepulse (Experiment 2). In addition, the amplitude of the test Change-N1m correlated positively with both the amplitude of the prepulse-evoked response and the degree of inhibition, suggesting that subjects who are more sensitive to the auditory change are more strongly inhibited by the prepulse. CONCLUSIONS: Since Change-N1m is easy to measure and control, it would be a valuable tool to investigate mechanisms of sensory gating or the biology of certain mental diseases such as schizophrenia.

Effects of acute nicotine on auditory change-related cortical responses.

RATIONALE AND OBJECTIVE: Nicotine is known to have enhancing effects on some aspects of attention and cognition. The purpose of the present study was to elucidate the effects of nicotine on pre-attentive change-related cortical activity. METHODS: Change-related cortical activity in response to an abrupt increase (3 dB) and decrease (6 dB) in sound pressure in a continuous sound was recorded by using magnetoencephalography. Nicotine was administered with a nicotine gum (4 mg of nicotine). Eleven healthy nonsmokers were tested with a double-blind and placebo-controlled design. Effects of nicotine on the main component of the onset response peaking at around 50 ms (P50m) and the main component of the change-related response at around 120 ms (Change-N1m) were investigated. RESULTS: Nicotine failed to affect P50m, while it significantly increased the amplitude of Change-N1m evoked by both auditory changes. The magnitude of the amplitude increase was similar among subjects regardless of the magnitude of the baseline response, which resulted in the percent increase of Change-N1m being greater for subjects with Change-N1m of smaller amplitude. CONCLUSIONS: Since Change-N1m represents a pre-attentive automatic process to encode new auditory events, the present results suggest that nicotine can exert beneficial cognitive effects without a direct impact on attention.

The hollow-face illusion in infancy: do infants see a screen based rotating hollow mask as hollow?

We investigated whether infants experience the hollow-face illusion using a screen-based presentation of a rotating hollow mask. In experiment 1 we examined preferential looking between rotating convex and concave faces. Adults looked more at the concave-illusory convex-face which appears to counter rotate. Infants of 7- to 8-month-old infants preferred the convex face, and 5- to 6-month-olds showed no preference. While older infants discriminate, their preference differed from that of adults possibly because they don't experience the illusion or counter rotation. In experiment 2 we tested preference in 7- to 8-month-olds for angled convex and concave static faces both before and after habituation to the stimuli shown in experiment 1. The infants showed a novelty preference for the static shape opposite to the habituation stimulus, together with a general preference for the static convex face. This shows that they discriminate between convex and concave faces and that habituation to either transfers across a change in view. Seven- to eight-month-olds have been shown to discriminate direction of rigid rotation on the basis of perspective changes. Our results suggest that this, perhaps together with a weaker bias to perceive faces as convex, allows these infants to see the screen-based hollow face as hollow even though adults perceive it as convex.

The development of the ability of infants to utilize static cues to create and access representations of object shape.

A "transfer-across-depth-cues" method was used to explore the development of the ability to generate and use spatial representations of an object as specified by static pictorial depth cues. Infants were habituated to an object with depth specified by one cue and then presented with the same shape with depth specified by a different cue. Only if an abstract representation of that object had been formed could transfer across cues occur. Shading and line junctions uniquely determined the 3D shapes in these displays so that they appeared to be either a slice of cake with a flat top or a rocket. Without these cues, both line drawings were identical. Infants aged 6 to 7 months showed significant evidence of transfer, while infants aged 4 to 5 months did not. A control experiment demonstrated that the younger infants could discriminate between the objects when a single depth cue specified the shapes. These results are similar to our previous findings, which indicated that 6- to 7-month-old infants show transfer across shading and surface-contour cues, specifying convex and concave surfaces (A. Tsuruhara, T. Sawada, S. Kanazawa, M. K. Yamaguchi, & A. Yonas, 2009). This work supports the hypothesis that the ability to form 3D spatial representations from pictorial depth cues develops at about 6 months of age.

Infant's ability to form a common representation of an object's shape from different pictorial depth cues: A transfer-across-cues study.

The purpose of this study was to explore the infants' ability to perceive 3D shape from pictorial depth cues. While several previous studies showed that infants discriminate between displays which differ in pictorial information for depth and can use this information to direct reaching, it is not clear that infants form a common representation of an object's shape from different pictorial depth cues. To clarify the infants' ability for pictorial depth cues, we employed a "transfer-across-depth-cues" method with four-to-five-month-old and six-to-seven-month-old infants. Using this method, we examined the transfer between two pictorial depth cues: shading and surface contours. Infants were habituated to a 3D shape specified by one cue and were then presented with the same shape and a novel shape, both specified by the other depth cue. In this situation the familiar shape could be detected only if one perceived the 3D shape from the pictorial depth cues. Our results indicated that older infants showed a significant novelty preference while the younger group did not. We found that, at least by six-to-seven-months old, infants develop a common representation over different pictorial depth cues.

Infants can't discriminate the orientation of a grating surrounded by an oblique square.

We examined whether infants could visually discriminate the orientation of a grating surrounded by an oblique square (experiment 1) and a vertical square (experiment 2). A familiarisation-novelty preference procedure was used. In experiment 1, infants aged 4 to 6 months did not visually distinguish the orientation of a grating surrounded by an oblique square. However, in experiment 2, in which a vertical surrounding square was used, such infants visually distinguished the orientation of a grating. Our results suggest that the external visual frame can affect infants' perception of the orientation of a grating, as it does in adults. In experiment 1, a grating was within an oblique square. Here, the relative orientation with respect to the external visual frame differs from the orientation relative to the retinal/gravitational axes. Such discrepancy appears to cause confusion in infants' perception of orientation.